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Abstract 

In the present paper, we study the evolution of an overloaded cyclic polling model that 
starts empty. Exploiting a connection with multitypc branching processes, we derive fluid 
asymptotics for the joint queue length process. Under passage to the fluid dynamics, the 
server switches between the queues infinitely many times in any finite time interval causing 
frequent oscillatory behavior of the fluid limit in the neighborhood of zero. Moreover, the fluid 
limit is random. Additionally, we suggest a method that establishes finiteness of moments 
of the busy period in an M/G/l queue. 

Keywords: Cyclic polling, overload, random fluid limit, branching processes, multi-stage 
gated discipline, busy period moments. 
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1 Introduction 

This paper is dedicated to stochastic networks called polling models. Broadly speaking, a polling 
model can be defined as multiple queues served one at a time by a single server. As for further 
details — service disciplines at the queues, routing of the server, and its walking times from one 
queue to another — there exist numerous variations motivated by the wide range of applications. 
The earliest polling study to appear in the literature seems to be by Mack [15J (1957), who 
investigated a problem in the British cotton industry involving a single repairman cyclically 
patrolling multiple machines, inspecting them for malfunctioning and repairing them. Over the 
past few decades, polling techniques have been of extensive use in the areas of computer and 
communication networks as well as manufacturing and maintenance. Along with that, a vast 
body of related literature has grown. For overviews of the available results on polling models and 
their analysis methodologies, we refer the reader to Takagi [TTl [THJ, [19] , Boxma [3], Yechiali [25] 
and Borst [2]. 

Across the great variety of polling models, there exists the "classical" one, which was first used in 
the analysis of time-sharing computer systems in the early 70's. This model is cyclic, i.e. if there 

are / queues in total, they are visited by the server in the cyclic order 1, 2, . . . , /, 1, 2, All 

of the queues are supposed to be infinite-buffer queues, and to each of them there is a Poisson 
stream of customers with i.i.d. service times. After all visits to a queue, i.i.d. walking, or 
switchover, times are incurred. All interarrival times, service times and switchover times are 
mutually independent, and their distributions may vary from queue to queue as well as the 
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service disciplines. Examples of the most common service disciplines are exhaustive (the queue 
is served until it becomes empty), gated (in the course of a visit, only those customers get served 
who are present in the queue when the server arrives to, or poll, the queue), and k-limited (at 
most k customers get served per visit). The present paper is also centered around the classical 
polling model. We assume zero switchover times and allow a wide class of service disciplines 
that includes both exhaustive and gated policies and is discussed later in more detail. 

Amongst desirable properties of any service system, the first one is stability. So, naturally, 
the major part of the polling related literature is focused on the performance of stable models. 
Foss & Kovalevskii [7J obtained an interesting result of null recurrence over a thick region of 
parameter space for a two-server modification of polling. MacPhee et al. \13\ HH] have recently 
observed the same phenomenon for a hybrid polling/ Jackson network, where the service rate 
and customer rerouting probabilities are randomly updated each time the server switches from 
one queue to another. 

The study of critically loaded polling models was initiated about two decades ago by Coffman 
et al. [H [5], who proved a so called averaging principle: in the diffusion heavy traffic limit, 
certain functionals of the joint workload process can be expressed via the limit total workload, 
which was shown to be a reflected Brownian motion and a Bessel process in the case of zero and 
non-zero switchover times, respectively. In subsequent years, the work has been carried on by 
Kroese [12] . Vatutin & Dyakonova [20], Altman & Kushner [I], van der Mei [21] and others. In 
particular, heavy-traffic approximations of the steady state and waiting time distributions have 
been derived. 

Although overloaded service systems are an existing reality and it is of importance to control 
or predict how fast they blow up over time, to the best of our knowledge, for polling models 
this problem has not been addressed in the literature so far. The present paper aims to fill in 
the gap. Moreover, this appears to be a really exciting problem because it reveals the following 
unusual phenomenon. Our interest is in fluid approximations, i.e. the limit of the scaled joint 
queue length process 

(Q 1 ,...,Q I )(xM-)/x<ri 

along a deterministic sequence x^ — >• oo. Remarkably, in contrast to the many basic queueing 
systems with deterministic fluid limits, overloaded polling models preserve some randomness 
under passage to the fluid dynamics. Other examples of simplistic designs combined with random 
fluid limits are two-queue two-server models of Foss & Kovalevskii [7] and Kovalevskii et al. [11] . 
To the latter work [11] , we refer for an insightful discussion of the nature of randomness in fluid 
limits in general and for an overview of the publications on the topic. 

To illustrate the key idea that has led us to the result, consider the simple, symmetric model 
of I = 2 queues with exhaustive service, zero switchover times and empty initial condition 
(without the last assumption, the analysis becomes much simpler). In isolation, the queues are 
stable, and the whole system is overloaded, i.e. 1/2 < A//i < 1, where A and 1/fi are the arrival 
rate and the mean service time, respectively (in both queues). Denote the supposedly existing 
limit queue length process by (Q 1 , (^X')- Note that, given the limit size of the queue in service 
at any non-zero time instant, the entire trajectories of both queues can be restored by the SLLN. 
Indeed, the limit total population (Q l + Q2XO grows at rate 2A — /U. Because of the symmetry, 
at any fixed time T > 0, the queues might (in the limit) be in service with equal probabilities, let 
it be queue 1. Then in Fig. Q] the limit queues 1 and 2 follow the solid and dashed trajectories, 
respectively. Starting from time T, the limit queue 1 gets cleared up at rate A — n until it 
becomes empty, say, at time Since t , when the limit total population (2A — fi)t comes 

—(2) 

from queue 2 alone, queue 2 gets cleared up at rate A — fi until it becomes empty at time t , 
while queue 1 grows at the arrival rate A. Moving forward and backward in this way, one can 
continue the two trajectories onto [T, oo) and (0, T], respectively, and see that they oscillate at 
an infinite rate when approaching zero. Now, the same algorithm applies if X 1 ) is known, which 
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is the first switching instant after T, and the following crucial observation makes it possible 
to find the distribution of (so the randomness of t^ makes the fluid limit random). Let 
customer 2 to be a descendant of customer 1 if customer 2 arrives to the system while customer 1 
is receiving service, or customer 2 is a descendant of a descendant of customer 1. Then the size 
of the non-empty queue at switching instant form a branching process. 



(Qi+Q 2 X«) 




Figure 1: Fluid limit of a symmetric two-queue model with exhaustive service 

The idea of representing arriving customers as descendants of the customer in service, has 
appeared in Foss [B] in the studies of an extension of Klimov's /uc-rule, and then in Resing j!6j . 
who introduced a wide class of service disciplines that, for the classical polling model (more 
general periodic server routing is also allowed), guarantee the joint queue length at the successive 
polling instants of a fixed queue to form a multitype branching process (MTBP). This embedded 
MTBP is the cornerstone of the analysis that we carry out in this paper. 

We now describe the class of service disciplines that we allow in this paper. It is a subclass of 
the MTBP-policies, and we call them multigated meaning that each visit of each queue consists 
of a number of consecutive gated service phases. The upper bound on the number of phases, 
called the gating index, comes from the input data (together with the interarrival and service 
times). Gating indices for different visits of the same queue are i.i.d. random variables whose 
distribution may vary from queue to queue, and gating indices for different queues are mutually 
independent. Gating indices equal 1 and oo correspond to exhaustive and the classical gated 
service, respectively. Multigated policies with deterministic gating indices were studied (and, 
in fact, introduced) recently by van Wijk et al. [23] with the purpose of balancing fairness and 
efficiency of polling models. Van der Mei and co-authors \22\ [23] consider multi-stage gated 
policies, but those are different than in (23] and here. 

Throughout the paper, we consider the case of zero switchover times. The case of non-zero 
switchover times can be treated with similar methods. 

As for the proofs, multiple asymmetric queues with non-exhaustive service create more work 
compared to the simple two-queue example discussed above. Knowing the limit total population 
is of little use now since it only reduces the dimension of the problem by one. We show that, 
in general situation, the fluid limit queue length trajectory (Qi, ■ ■ . , Qj)(-) is determined by 21 
random parameters: the earliest polling instants that, in the limit, follow a fixed 

time instant, and the limit sizes . . . , Qi(pi) of the corresponding polled queues. The 

overload assumption and multigated policies provide the framework of supercritical MTBP's, 
and we can apply the Kesten-Stigum theorem [91 [10] (the classical result on asymptotics of 
supercritical MTBP's) to find the distribution of, for example, (Qi, ■ ■ ■ , Qi)(t\). Then suitable 
SLLN's imply that the the other parameters t\, . . . Q 2 (t2), • • • , Qi(ti) can be expressed either 
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via the Kesten-Stigum limit (Q l5 . . . , Qj)(ti) or via each other. Note also that the Kesten-Stigum 
theorem requires certain moments of the offspring distribution to be finite. The visit at a queue 
is the longest when service is exhaustive, implying more customers in the other queues in the 
end of the cycle. So attempts to satisfy the moment conditions of the Kesten-Stigum theorem 
boil down to proving finiteness of the corresponding moment for the busy period of an M/G/l 
queue, which is an interesting and novel result by itself. Besides, we obtain an estimate for this 
moment, and our approach is valid for a wide class of regularly varying convex functions, in 
particular power and logarithmic functions. 

The rest of the paper is organised as follows. Section [2] describes the cyclic polling model 
and the class of service disciplines. Section [3] explains the connection between the model and 
MTBP's, gives some preliminaries from the theory of MTBP's and derives characteristics of the 
embedded MTBP. In Section^ we state our main result — the fluid limit theorem — and discuss 
the optimal representation of the fluid limit from the computational point of view (Remark [5]). 
Section [5] proves the results of Section [3l see the proof of Lemma [3] for estimates on the moments 
of the busy period of an M/G/l queue. Section [6] proves the fluid limit theorem. Proofs of some 
auxiliary statements are given in the Appendix. 



Notation With x := y we mean that x is defined as equal to y. 

The standard sets are: positive integers N := {1, 2, . . .}, non-negative integers Z + := N U {0}, 
integers Z = {0, ±1, ±2, . . .}. 

All vectors are /-dimensional row vectors, - T denotes the operation of transposition. All vector 
notations are boldface. The vector with all coordinates equal is denoted by 0, with all coordi- 
nates equal 1 by 1, and with coordinate i equal 1 and the other coordinates equal by e^. The 
following operations are defined on vectors x = (x±, . . . , x/), y = (y±, . . . ,yi), 

• partial order: x < y if xi < yi for all i; 

• Li-norm |x| = Ya=i x u 

• coordinate-wise product x x y = (xij/i, . . . , xjyi); 

• power: if all x; L > 0, then x y = n^i^ x T'i 

• binomial coefficient: if x, y € Z+ and y < x, f ) = TTf=i I ' I = Flf-i — 77 — ~ rr- 

\yj \ViJ yV\Xi-yi)\ 

For a real x, let [x\ be its maximum integer lower bound, \x~\ its minimum integer upper bound, 
and put {x} = x — [x\. 

If a superscript is in parentheses, then it is an upper index, otherwise a power. 

If random objects X and Y are equal in distribution, we write X = Y and say that X is a copy 
of Y. 



2 Model description 

This section contains a detailed description of the cyclic polling model and the class of ser- 
vice disciplines that we allow for this model. It also specifies the stochastic assumptions. All 
stochastic primitives introduced throughout the paper are defined on a common probability 
space (ft, J-, ¥) with expectation operator E. 



Cyclic polling Consider a system that consists of multiple infinite-buffer queues labeled by 
i = 1, . . . , I, where / is finite, and a single server. There are external arrivals of customers to the 
queues that line up in the corresponding buffers in the order of arrival. The server idles if and 
only if the entire system is empty. While the system is non-empty, the server works at unit rate 
serving one queue at a time and switching from one queue to another in the cyclic order: after 
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a period of serving queue i, called a visit to queue i, a visit to queue i mod 7+1 follows. Note 
that, while the system is non-empty, empty queues get visited as well in the sense that, once the 
server arrives to (or, polls) an empty queue, say at time t, it has to leave immediately, and the 
visit in this case is defined to be the empty interval [t, t). Now suppose that, at a particular time 
instant, the system empties upon completion of a non-empty visit to queue i. For mathematical 
convenience, we assume that such an instant is followed by a single (empty) visit to each of the 
empty queues i + 1, . . . , I . Then the server idles until the first arrival into the empty system. If 
that arrival is to queue i, a single (empty) visit to each of the empty queues 1, . . . , i — 1 precedes 
the visit to queue i. In the course of a visit, a number of customers at the head of the queue 
get served in the order of arrival and depart. The service disciplines at the queues specify how 
many customers should get served per visit, we now proceed with their description. 

Multigated service With multigated service in a queue we mean that each visit of that queue 
consisits of a number of consecutive gated service phases. More formally, we say that the server 
gates a queue at a particular time instant meaning that the queue is in service at the moment, 
and all the customers found in the queue at the moment are guaranteed to receive service during 
the current visit. Customers gated together are served in the order of arrival. For each visit, its 
gating index is defined: it is the upper bound on the number of times the server is supposed to 
gate the queue in the course of the visit. The gating indices for different queues and for different 
visits of the same queue might be different. The first time during a visit when the server gates 
the queue is upon polling the queue. The other gating instants are defined by induction: as 
soon as the customers found in the queue the last time it was gated have been served, the queue 
is gated again provided that the total number of gating procedures is not going to exceed the 
gating index. If the queue is empty upon gating, the server switches to the next queue, and thus 
the actual number of gating procedures performed during a visit might differ from the gating 
index for that visit. Now we define a generic multigated service discipline. 

Definition 1. Let a random variable X take values in Z + U {oo}. The service discipline at 
a particular queue is called X -gated if the gating indices for different visits of this queue are 
i.i.d. copies of X. If a gating index equals 0, the server should leave immediately after polling the 
queue. The values 1 and oo of a gating index correspond to conventional gated and exhaustive 
service, respectively. 

Remark 1. Multigated service disciplines guarantee the population of the polling system at 
polling instants of a fixed queue to an MTBP, laying the foundation for the analysis that we 
carry out in this paper. We discuss this connection with MTBP's in detail in the next section. 

Stochastic assumptions We consider the cyclic polling system described above to evolve in 
the continuous time horizon t € [0, oo). At t = 0, the system is empty. Arrivals of customers to 
queue i form a Poisson process Ei(-) of rate Aj. Introduce also the vector of arrival rates 

A:= (A l5 ..., A/). 

Service times of queue % customers are drawn from a sequence {B^} n& ^ of i.i.d. 

copies of a positive random variable Bi with a finite mean value . Gating indices for queue i 

are drawn from a sequence {X^ n '} n ^ of i.i.d. copies of a random variable Xi taking values 

in Z + U {oo}. The random elements Ei(-), {B> n '} ne f$ and {X^} ne ^, i = 1, . . . , I, are mutually 

independent. Additionally, we impose the following conditions on the load intensities and service 

times. 

Assumption 1. For all i, < 1, and Yll=i -Ww > 1- 

Assumption 2. For all i, KBilogBi < oo. 
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We study the system behavior in terms of its queue length process 



Q(-) = (Qi,...,Q/)(-), 
where Qi(t) is the number of customers in queue i at time t. 

3 Connection with MTBP's 

This section is devoted to a multitype branching process (MTBP) embedded in the queue length 
process Q(-) and enabling its further analysis. 

To start with, we divide the time horizon into pairwise-disjoint finite intervals in such a way 
that each interval includes a single (possibly, empty) visit of the server to each of the queues 
starting from the first one. Let 

[0,oo) = |J 
[^),^+ 1 )) = [tH,^)^ = J^,^ 1 ), 

where 

. t(°) = and *(»> < tS n) < • • • < 4+1 = * (n+1) ; 

• if the system is empty at t^ n \ then the interval [t^ n \ti) is the period of waiting until the 
first arrival, otherwise = t^ 1 , 

• the interval [^ n \4+i) ^ s the visit to queue i following t^ n \ with = if the visit is 
empty. 

The interval [t^ n \ *( n+1 )) is called session n. The interval [f^ n , 4+i) is called mszi n to queue i, 

(n) 

and the gating index for this visit is X- . 

For multigated service disciplines that we consider in this paper, the following holds. 

Property 1. For alii = 1, ... ,1, the customers found in queue i at a polling instant get replaced 
during the course of the visit by i.i.d. copies of a random vector Lj = (La, . . . that has 

the distribution of Q(4+i) — Q(4 ) given that Q(^ n ' ) ) = ej (this distribution does not depend 
on n). 

By Resing [16], Property Q] implies that the sequence 

{Q(t (n) )W+ 

forms an MTBP with immigration in state 0. In the rest of the section, we introduce a number 
of objects associated with this MTBP and discuss some of its properties. 

The random vector Lj mentioned in Property [T] we call the visit offspring of a queue i customer. 
Define also the visit duration at queue i to be a random variable Vj equal in distribution to 
H+l ~ 4™"* gi ven that Qiilf 1 ') = 1, and the session offspring of a queue i customer to be 
a random vector Lj = (Lj^, . . . , Lij) that has the distribution of Q(^ n+1 ^) — Q(t^ n ^) given that 
Q (*(")) = ej. Then the immigration distribution is given by 

G(k) := P{Q(^ +1 >) = k|Q(*W) = 0} = V 7 AjP{Lj = k}/ T 1 Aj, k G Z + . 

The following lemma computes the mean values 

7j:=EVj, rhj = (m^i, . . . ,m itI ) : = ELj, rrij = (m^i, . . . , my) := ELj. 
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Lemma 1. For all i, 



rhii = ¥,(\i/m) Xi and 7, 



mi 



Pi ~ 

and, for i^j, 

For the rriij 's, there is a recursive formula: 

mi j = rhij for all j, 
and, for i = 1, . . . , I — 1, rrij is computed via rrij + i, 

> j} + 2_^ k= . +l m i:k m k j for all j. 



m 



h3 ~ 

The proof follows in Section 15.11 

By the Perron-Frobenius theorem (see e.g. Theorem 5.1]), the mean session offspring matrix 
M := {m,jj} 7 •_ 1 has a positive eigenvalue p that is greater in absolute value than any other 
eigenvalue of M. The eigenspace associated to p is one-dimensional and parallel to a vector with 
all coordinates positive. Then there exist vectors u = (m, ■ • • , ui) and v = (v±, . . . , vj) with all 
coordinates positive such that 

Mu T = pu T , vM = pv and vu T = 1. 

Now introduce an auxiliary MTBP {Z^ n ^} ng 2 + with no immigration and such that, given 
Z( n ) = ej, the next generation Z^ n+1 ^ is equal in distribution to Lj. Denote by qi the ex- 
tinction probability for the process {Z( n )} nG z + given that Z^ ) = e$, and introduce the vector of 
extinction probabilities 

q:= (q 1 ,...,q I ). 

Then the probability for the process {Q(t^)} n ^z + to return to is given by 

^=£ k6Z ,G(k)q*. 

Remark 2. Since all time instants t such that Q(i) = are contained among the tW's, the 
probability for the process Q(-) to return to equals qc, too. 

By Assumption [TJ the MTBP's {Q(i^)} n ez+ an d {Z( n )} ne ^ + are supercritical (the proof is 
postponed to the Appendix). 

Lemma 2. For the Perron-Frobenius eigenvalue p and the extinction probabilities qi, we have 
p > 1 and qi < 1 for all i. By the latter, qc < 1, too. 

Assumption [2] guarantees finiteness of the corresponding moments for the offspring distribution 
of the MTBP's {Q(t (n) )} ne z: + and {Z^} n€Z+ (see Section E2 for the proof). 

Lemma 3. For all i and j, ELjj logLjj < 00, where OlogO := by convention. 

Finally, we quote the Kesten-Stigum theorem for supercritical MTBP's (see e.g. [9J, [10] ) , which 
is our starting point when proving the convergence results of the next section. By that theorem 
and Lemmas [2] and [3l the auxiliary process {Z^ n ^} ne z + has the following asymptotics. 

Proposition 1. Given = e/, 

Z( n )/p n -»■ a.s. as n ->• 00, 

where the distribution of the random variable Q has a jump of magnitude qi < 1 at and 
a continuous density function on (0,co), and E£j = Ui. 
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4 Fluid limit 



In this section, we present out main result which concerns the behavior of the model under study 
on a large time scale. 

For each n € Z+, introduce the scaled queue length process 

Q (n \t):=Q(p n t)/p n , ie[0,oo). (1) 

We are interested in the a.s. limit of the processes ([1]) as n —> oo, which we call the fluid limit 
of the model. It appears that, in order to precisely describe the fluid limit, the information 
provided by the following theorem is sufficient. 

For n£Z, let 

min{A;: > p n } if n > 0, 
if n< 0. 



Vn 



Theorem 1. There exist constants b{ € (0, oo) and = (ttj i, . . . , a^j) € [0, oo) 1 , i = 1, . . . , 1+1, 
and a random variable £ with values in [1, p) suc/i i/iai, /or a// A; G Z + and i, 

t (vn+k)/ p n p k^ and Q(^"+ fc ))/ p « ^ a . s . as „ oo. ( 2 ) 

T/ie 6j 's and a^ 7 s are given by 

h = l, b i+1 =li + (vi/a + \i(b~i -bi))~/i, i = l,...,I, (3) 

and 

si 1 =v/a a i+ i = + (b i+1 - 6j)A - (6 i+1 - b^mei, i = l,...,I, (4) 

w/iere 



T/ie distribution of £ is given by 

^ > X} = ^-L- £ kezi> G(k) £j< k , ft) (1 - q/q^'x 

yG lkl>l I'l^ 1 v y 

xPjOog^a^^^e? )} > log p x}, x € [l,p), 



where Q , j € N, are i.i.d. random variables with the distribution of Q given that Q > 0, and 
the sequences {£• }jeN> i = 1, • • • , o-re mutually independent. 

The proof of Theorem [1] combines the Kesten-Stigum theorem with various dynamic equations 
and laws of large numbers, see Section 

Remark 3. Since t^) l = t^, we also have 

= pb\ and a/+i = pai. 

Remark 4. There is an alternative way to compute the Oj's: 

ai = «, a»+i = ai - a^e; + a^riij, i = l,...,J, 

which implies that a^,- > if \i — j\ ^ 1 and aa+x = if and only if the service discipline 
at queue i is exhaustive. See Lemma [7] and Remark [7J in Section [6721 
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Based on the results of Theorem [TJ Theorem [2] below derives the fluid limit equations from the 
suitable dynamic equations, see Section [6] for the proof. 

Theorem 2. There exists a deterministic function Q(-) = {Q\, ■ ■ ■ , Qi)(-) '■ [0, oo) — > [OjOo) 1 
such that, 

a.s. as n —¥ oo, Q n (•) — > £Q(-/0 uniformly on compact sets, 
where the random variable £ is defined in Theorem{J\ 
The function Q(-) is continuous and piecewise linear and given by 



Q(t) 







ift = 



p k ai + (t- p%)\ -{t- p k bi)mei ift € \p k b { , p%+i), i = 1, . . . , I, k 6 Z, 
or, equivalently, by 



(5) 



QM = { 



( ift = 0, 

p k a iti + (A 4 - Ati)(t - i/ 1 G [p%, P^i+i^ k£Z, 

{ p k+1 a hl - Xiip^bi -t) ift€ [p k b l+1 , p k+1 bi), k G 3 



1,...,/. 



(6) 



Remark 5. By ([6]), the whole process Q(-) is defined by the constants 6, and a^j. The fastest 
way to compute the &j's and a^j's is using the simultaneous recursion 

bx = 1, a i;i = «i/a + Ai(6i - &i), 6 i+ i = 6j + Oj,i7i, i = l, 

See the last part of the proof of Lemma [7] (namely, (f33|) and (fM|) ) and Remark [7] in Section 

Finally, Fig. [2]depicts a trajectory of the limiting process 



P k ai,i£ 




P k H P k h + it P k+1 U 

Figure 2: Fluid limit of queue i 



5 Proofs for Section [3] 

Here we prove the properties of the offspring distribution of the embedded MTBP {Q(i^)}nez+ • 
5.1 Proof of Lemma Q] 

First we compute the 7j's. For k £ Z + U {oo}, let a random variable Vi(k) be the visit duration 
at queue i given that the service discipline at queue i is k- gated. 

Recall that the gating index equal oo corresponds to exhaustive service, and hence 



E^(OO) = l/(/Zi - A;). 
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Now note that 

Vi(0)=0 and Viik + V^Bi + Y^^vPik), G Z+. (7) 

where the random elements £?j, Ei(-) and {V i (k)}i e ^ are mutually independent, and V®(k), 
I G N, are i.i.d. copies of Vi(fe). Then, for k G Z+, 

2 



EVi(k + 1) = - + -EVi(k) = - ( 1 + ^ j + ( ^ ) EFi(fc - 1) = . . . 

Mi Mi Mi V Mi/ VMi/ 

- 1 fi + * + . . . + v V r E7 4( o) - 1 1 - ( x ^ k 



(8) 



Mi I Mi VMi/ / VMi/ Mi 1-Ai/M 

and 

1 - E(Ai/Mi) Xi 



fceZ + U{oo} yUj — Aj 

In a similar way, we compute the m^j's. For A; G Z + U {oo}, let a random variable Ljj(fe) be 
the queue i visit offspring of a queue i customer given that the service discipline at queue i is 
k- gated. Since 

L M (oc) = 0, L M (0) = 1 and L iti (k + 1) = Z,g (fc), fc G Z+, 

where the random elements £?j, -Ei(-) and {-£f](^)}ieN are mutually independent, and LfJ(k), 
I G N, are i.i.d. copies of L^i(k), we have 

EL M (fc + 1) = (A i /Mi)E J L i>i (fc) = . . . = (Ai/Mi) fe+1 , fc G Z+, and m M = E(A i / / u,) Xl - 

The formulas for the fhij's, i ^ j, and the rriij's follow, respectively, by the representations 

Lij^EjW, i^j, (9) 
where Vi and Ej(-) are independent, and 



d_ J ^ij + J2i=i +1 L f+i,j + ■ ■ ■ + 12i=i 1 - h n \ 

( Z^i=i ^i+l,j + • • • + Zw=i L i,j-> l <3, 

where L^j, I G N, are i.i.d. copies of Ljj, and the sequences {-kfjlzeNj = l?---?-^ are 

mutually independent and do not depend on the vectors Li, i = 1, . . . , J. □ 



5.2 Proof of Lemma [3] 

The cornerstone of this proof is finiteness of the corresponding moments for the busy periods 
of the queues in isolation, which we check with the help of the auxiliary Lemmas H] and [5] that 
follow below together with their proofs. 

Lemma 4. Suppose that a function /(•): [0, oo) — > [0, oo) is bounded in a finite interval [0, T] 
and non- decreasing in [T, oo), and that f(x) — > oo as x — > oo. Suppose also that, for some (and 
hence for all) c > 1, 

limsup/(cx)//(x) < oo. (11) 

x— >oo 

Consider an i.i.d. sequence {Y^ n ^ n ^ of non-negative, non- degenerate at zero random variables, 
and the renewal process 

Y{t) = max{n G Z + : YT- Y (k) <t}, t G [0, oo). 

Let t be a non-negative random variable which may depend on the sequence {Y^jneN- Assume 
that E/(t) < oo. Then E/(Y(t)) is finite too. 



10 



Remark 6. Note that, in the last lemma, dependence between r and {l^lneM is allowed. 

Proof of Lemma [^J Without loss of generality, we can assume that the function /(•) is non- 
decreasing in the entire domain [0, oo) (otherwise, instead of /(•); one can consider /(•) = 
su Po<y<- /(?/)); an d also that /(•) is right-continuous. 

First we show that, if ([lip holds for some c > 1, then it holds for any d > 1. For d = c k , k G N, 
we have 

f(c k x) f(c k x) f (c k ~^x) f (ex) 

Jim sup < lim sup lim sup f( k _ 2 , ■ ■ ■ lim sup — — < oo. 

£— »oo Jl-^J x— >oo j^C Xj x— s-oo j^C XJ x— >oo J\X) 

Then, for d > 1 other than powers of c, ([lip follows by the monotonicity of /(•)• 
Condition (fTTj) also implies that 

lim log(/(x))/x = 0. (12) 

x— too 

Indeed, since M := lim sup^^ f(ex)/f(x) < oo, there exists a large enough T' > such 
that sup^g^/ ^) f(ex)/f(x) < 2M. Note that any x G [eT',oo) admits a unique representation 

x = e k ( x ^y(x), where y(x) G [T",eT") and k(x) € N. Hence, for any x G [eT',oo), 

Hx) - fj^m f±yMl f(vix)) < m) m f(er) 

and 

log(/(a)) < fc(x)log(2M)+log(/(er / )) 
x ~ T'e*^) 

implying ([TZj) . 

Now define the inverse function 

f^\y) := inf{x G [0, oo) : f{x) >y}, y G [0, oo). 

For any d > 0, we have 

E/(F(r)) < ^ P{/(F(r)) > n} 

< E ez ^ w * < E PZ p {El /C r )(n)1 ^ r > 

* — 'n£ZL|_ * — 'fc=l * — 'ngZ+ 

* v ' * v ' 

= : Sl(c') =: S 2 (c') 

By condition (|11[) . Kf(r/d) < oo for any c' > 0, and hence 

S 2 (c') < E c ^ ^/(^AO > n} < 1 +E/(r/c') < oo. 

We now pick a c' such that Si(c') < oo, and this will finish the proof. By Markov's inequality, 
p {Efc=i y(fc) ^ c ' n i = P{e-^fe=i y<fc) > e" c ' n } < (e c 'Ee- y(1) ) n . Let d be small enough so that 



c : 



:= e c Ee y<1) < 1. Since [/( ^ (?"&)] = m implies n < f(m + 1), we have 



s i( c ')<E P7 nY^ Y {k) ^ c ' m }f( m+1 )^^H PN ^ m f^- 

* — 'm£Z-t- * — 'fc=l c z — 'men 

Take an e G (0, | log(c)|). By ()12p . there exists a large enough NgN such that f{m) < e m£ for 
m > N. Then 

C ' — 'm=l c — 'm=N+l 

where ce e = e e_ ' log ^' < 1 by the choice of e, and hence Ei(c') < oo. □ 
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Lemma 5. Consider a sequence {Y^} n ^ of non-negative random variables that are identically 
distributed (but not necessarily independent), and also a "L + -valued random variable n that does 
not depend on {Y( n )} ne N- If /(") : [0>°°) ~> ^ * s a convex function, then 

E/(^ =i r( fe ))<E/(r ? Y«). 
Proof. By the convexity of /(•)) for any n G Z + , 

E /(EI , y(fe) ) = E -f EI , 1 (« y(fc) )) ^ El , -E/(»r (Jfc) ) = E/(nF«). 

' — 'fc=i * — 'fc=i n * — »fe=i n 
Then, by the independence between {y( n )} ng N and n, 

< P{r? = n}E/(ny (1) ) = E/(? ? y (1) ). □ 



Now we proceed with the proof of Lemma O It suffices to show that 

E/(Ljj) < co, for all i and j, 

where 

m = S°- «m. 

[ x log x, i£ [I, coj. 

Note that the function /(■) is convex: in (1, co), its derivative log(-) + 1 is non-decreasing, and 
in the other points, it is easy to check the definition of convexity. 

Also note that 

f(xy) <xf(y) + yf(x), x,ye[0,oo). (13) 

The rest of the proof is divided into three parts. The two key steps are to show that the f- 
moments of the visit duration Vi and the same type visit offspring L^j are finite. Then the 
finiteness of the /-moments of the session offspring Lij follows easily. 



Finiteness of E/(Vj) It suffices to show that, in the M/G/l queue with the arrival process 
Ei(-) and service times B^, n G N, the /-moment of the busy period is finite. Suppose that 
at time t = 0, there is one customer in the queue, and his/her service time B^ is equal in 
distribution to Bi and is independent from Ei(-) and {B^} n& ^. Let 

Tj = min{t G (0, co) : the queue is empty at t}, 

7i(0)=0, 75(l) = B{ 0) , n{k + 2) = n {k + i) + Y^^2) + i B ^' heZ+ - 

Whilst Ti is a busy period, Ti(k) is equal in distribution to the visit duration in queue i of the 
polling system given that the service discipline in that queue is A;-gated, and 

Tj(fc) t Ti a.s. as k — s> co. 

Now we show that the moments E/(rj(/c)), k G Z+, are bounded. Then the finiteness of E/(rj) 
follows by the continuity of /(•) and the dominated convergence theorem. 

Mimicking (|7|) , we have 

n(k + i)^BP + ^ f) n(k) {l \ *>l, 
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where Ti{k)^ l \ I € N, are i.i.d. copies of Ti{k) that are independent from £r and Ei(-). Then, 
by the monotonicity and convexity of /(•), and the auxiliary Lemma combined with (|13|) . 

Ef(r l (k))<Ef(r l (k + l))<-Ef(2Bf ) ) + -Ef(2Y, l ^ % V.(fc)«) 

< htf(2Bf) + iE/(2 J B i ( J B; o) )r 4 (^) (1) ) 

< ^E/(2Bf°J) + ^E/(t#)) + ^Er^E/^^)), 
z /ij z 

where E/(2^(sf 0) )) < oo by the auxiliary Lemma H and En(k) < - A*) by (JSJ. 

Thus, for all > 2, 

E/(ri(fc)) < c/(l - Ai///i), 

where 

c = E/(2 J Bf ) )/2 + E/(2^( J Bf ) ))/(2( Mi - A;)) < oo. 

Finiteness of E/(Lj j) Note that Ljj is bounded stochastically from above by the number of 
service completions during the busy period of the M/G/l queue introduced when proving the 
finiteness of Kf(Vi). The number of service completions during the first busy period Tj is given 
by 1 + Eiiji), and the finiteness of E/(l + Ei{ji)) follows by the auxiliary Lemma [H 

Finiteness of E/(Ljj) This part of the proof uses mathematical induction. Now that we have 
shown the finiteness of the moments E/(Ljj), Q and Lemma [J] imply that 

Ef(Lij) < oo for all i and j. (14) 

Then we have the basis of induction: E/(L/j) = Ef(Ljj) < oo for all j. Suppose that 
E/(Lfcj) < oo for k = i + 1, . . . , I and all j. Then the induction step (from i + 1 to i) fol- 
lows by pU|) . the convexity of /(•), Lemma (JS]) combined with (|13|) . and (|14p . □ 

6 Proofs for Section |4] 

First we make preparations in Sections 16.11 and 16.21 and then proceed with the proofs of Theo- 
rems Q] and [2] in Sections 16.31 and 16.41 respectively. 

6.1 Additional notation 

In this section we introduce a number of auxiliary random objects that we operate with when 
proving the a.s. convergence results of the paper. 

Queue length dynamics Define the renewal processes 

B,i(t) := maxjn E Z+ such that B\ k) <t}, t € [0, oo), 

and the processes 

Ii(t) := / Ijqueue i is in service at time s}ds, t € [0, oo), 
Jo 

that keep track of how much time the server has spent in each of the queues. 
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Then the number of queue i customers that have departed up to time t is given by 

A(i) :=Bi(Ii(t)). 

Most of the a.s. convergence results of the paper we derive from the basic equations 

Q i {-) = E l {-)-D l (-). 

The preliminary results of Section T6.2I depend on when the system empties for the last time. The 
number of indices n such that Q(^ n ^) = has a geometric distribution with parameter qc < 1 
(see Lemma [2]). Denote by v the last such index, i.e. 

Q(tM) = and Q(t (n) ) + for all n > v. 

Ancestor-descendant relationships between customers By the following three rules, we 
define the binary relation "is a descendant of" on the set of customers: 

• each customer is a descendant of him- /herself; 

• if customer 2 arrives while customer 1 is receiving service (the two customers are allowed 
to come from different queues), then customer 2 is a descendant of customer 1; 

• if customer 2 is a descendant of customer 1, and customer 3 a descendant of customer 2, 
then customer 3 is a descendant of customer 1. 

Now suppose that a customer is in position k in queue i at the beginning of visit n to queue i. 

(n k) 

Denote by the amount of time during the visit that his/her descendants are in service, 

and by L\ ■ the number of his/her descendants in queue j at the end of the visit. If a customer 

(n k) 

is in position k in queue i at the beginning of session n, denote by L\- the number of his/her 
descendants in queue j at the end of the session. Introduce also the random vectors 

t (n,k) := (Z (n,fc) ) ^(n, fc)) ^ ^k) . = ^(n,^ . jL K*>). 

6.2 Preliminary results 

In this section, we characterize the asymptotic behavior of the system at the switching in- 
stants t\ , laying the basis for Theorem [1] that concerns the bigger scale times . 

(n) 

From the Kesten-Stigum theorem, we derive the following result for the t\ s. 
Lemma 6. There exists a positive random variable £ sitc/i t/iai 

Q(t (n) )/p n -Ku and Q(4 n) )/p n -> «■«• as n ^ oo. 
T/ie distribution of £ is given by 

iki>i 

x Ei<^ (i) c 1 - q)V~ Ip {E. = i E - =1 } £ ^ n+1 4, x e (o, oo), 



(15) 



(7) 

where the random variables Q are the same as in Theorem^ 

Proof. Since t^ = t^ for n > u, it suffices to find the a.s. limit of Q(t^) / p n . 

First we find the asymptotics of the auxiliary MTBP {Z( n )} ng pj (without immigration) under 
the assumption that Z(°) is distributed according to {G(k)} kGZ / (the immigration distribution 

for the MTBP {Q(t (n) )}„ eN )• 
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By Proposition [H if the distribution of Z^ ) is {G(k)} kgZ i , we have 

i (n) /p n (E kez , 1 { z(0) = k > E- =1 El v a - s - asn ^^ 

V V ' 

=-Cg 

where , j £ N, are i.i.d. copies of Q, and the sequences {Ci^}jeN> i = 1, • • • ,1, are mutually 
independent and also independent from Z^. 

The distribution of Cg is given by 

= 0} = q G , 



nc G >x} = G ( k ) E'<k, (%o) 
iki>i w>i w 



x (16) 



x n 7 , p {Ci > o} h n(i = o} k *~ h , x g (o, oo), 



(1 - tO^q 1 



where 



p(l) = P{ V 7 _ CF } > x I C 0) > for all i and j = 1, . . . , 

with the random variables £• defined in Theorem [0 
Now, on the event {v = N}, 

Q (iV+l+n)/ p n ^ ^ v a _ g> as n ^ QOj 

where 

P{Gv E ■} = P{Cg € -|ZW ^ for all nCZ + } = P{Cg G -|Cg > 0}. 

Then 

Q(t(»))/p» -> (E W6Z+ ^ = KKn/P** 1 ) v a.s. asn^», 



= :C 

and it is left to check that the distribution of £ is given by (fT5j) . 
For x G (0, oo), we have 

nc >x} = J2 N&+ F i u = ^wcg > ^ +1 x}/p{Cg > o}, 

and then (USD follows by ([IB]). □ 

To deal with the other ^ s, we combine the previous lemma with LLN's. 

Lemma 7. For i = 1, . . . , I , there exist constants bi G (0, oo) and &i = (a^i, . . . , a^j) G [0, oo) 7 
swc/i that 

ti/p n ^bi( and Q(t\ n ^/p n ) -> C a i «- s - as n oo. 
Tae 6j 's and aj 7 s are given by 

6l= E*=i^M_ 5 ft i+1 = b . + (u . + Ai ( 6i _ 6l )) 7i) i = i T ... j j > (17) 
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and 

ai = v, aj+i = &i + (6 i+ i - bi)X - (6 i+1 - h)^, i = l,...,I. (18) 
The &i 's also satisfy 

ai = v, a i+ i = &i - di^ei + a^ihj, i = 1, . . . , I. (19) 
Remark 7. As we compare (fTTj) - (fT8|) with ©-(HI), it immediately follows that 

bi = abi aj = aaj 

Proof of Lemma UJ First we show that the sequences of / p n and Q(ij n ^) converge a.s., and 
that their limits satisfy the relations (|18p . Then we derive equations (|17|) and (|19p relying on 
an LLN that, generally speaking, guarantees the frj's to be in-probability-limits only. 

in) 

Asymptotics of t\ By the definition of u, which is a.s. finite, we have, for n > u, 

* ' 

= : S 

where £ is a.s. finite. 

The last equation with A(t (n) ) = £i(i (n) ) - Qi{t {n) ) plugged in can be transformed into 



An) _ An) _ v , An) S^ 1 Lk=l B i ') n W 



v( n ) y( n ) 

— • ^i — ■ ^2 

and then into 

t^/p n = t^/p n = ^\- E/pn . (20) 
S 1 - 1 

By the SLLN and Lemma [6l 

vjW _^ Aj//.fi and sl n ^ — > Vi/pi)C a.s. as n — > oo, 

which, together with ()20p . implies that 

t {n)j p n _^ bi( - and An) _^ ^ & ^ ^ n _> ^ ( 2 1) 

where the value of b\ is the one claimed in the Lemma. 

Convergence of / p n Note that 

i W_^) = 7 i (^+l))_^(^)) ) 

and hence, 
By the SLLN, 



Pi a.s. as ?2 — ^ co. (23) 
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By the SLLN, flU} and Lemma El 



(Xibi — Vi)C a.s. as n — > oo. (24) 



p n t (n) p n p n 

As we put (|2ip ~ (|24p together, it follows that there exist positive numbers hi such that 

tf ] jp n ->• biC a.s. as n ^ oo, t = 1, . . . , I + 1. (25) 

(The value of &i is the one claimed in the Lemma, and the equations for the other fej's that 
follow from (|2i p - (|24p are not given here since they will not be used anywhere in the proofs.) 

Convergence of Q(tj)/p n and p8|) Since, during the time interval [t[ ,t|?\), there are no 
departures from queues other than i, we have 

Qj(tt\) ~ QsitW) = Ej (t^\) - E 3 {tt ] ) - i{j = ijmi^+V)) - Bf(I,(tW))). (26) 
By the SLLN and (|25]> . 

)■ Aj(Oj + i — OijC a.s. as n — > oo. (27) 



C a.s. as n —¥ oo, (28) 



By 425}, 

/»(* (w) ) _ E£i(*ffi-*i fc) ) t b l+1 - bl 
p n p n p — 1 

which, together with the SLLN, implies that 

^ ^ ^ -)■ W (6 m - 6,)C a.s. as n ^ oo (29) 

As we put Lemma [6] and (|26p -(|29 p together, it follows that 

Q(t\ n) )/P n -> ( a i a.s. asn^oo, i = l,...,/+l, (30) 
where the vectors a^ = (a^i, . . . , a^/) are given by (fl~8|) . 

Proof of (fTT)) and (fl~9P We derive (fTT|) from the equations 

Q t (t ( r ) ) = Q l (t i r ) ) + E t ( t \ n) ) - Eta™). (32) 

To (|31|) . we apply the following form of the LLN (the proof is postponed to the appendix). 

Statement 1. Let a random variable Y have a finite mean value and, for each n £ N, let 
Yn , k G N, be i.i.d. copies of Y . Let T n , n £ N, be Z, + -valued random variables such that 
r n is independent of the sequence {Y^ }k& f or each n and r n — > oo in probability as n — > oo. 
Finally, let a sequence {T n } nG N of positive numbers increase to oo. If there exists an a.s. finite 
random variable r such that T n /T n — >• r in probability as n — » oo, i/ien 

Ey n (fe) / T n^TEF in probability as n — > oo. 
fc=i 
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By (f3Tj) and Statement [H 

k+i -bi = a^ji. (33) 

By U32J and the SLLN, 

= Vi + Ai(6j - 61). (34) 

Then (JTJJ) follows as we plug §M§ into (1331) . 

Finally, (|19|) follows as we apply Statement [1] to the equation 



□ 



6.3 Proof of ThereomQ] 

This proof converts the results of Lemma [7J using the following tool. 
Lemma 8. Suppose that random variables Y^ n \ n G Z, and Y are such that 

yC«) / p n _^ Y ( a .s. as n ->• 00. 

Then, for all k G Z, 

Proof. First we show that, 

a.s., n — r\ n = [log p (aC)J for all n big enough. (35) 

Indeed, we have log p (t^ n ^) — n = log p (a£) + ^ ; where 5^ — > a.s. as n — >• 00. Then r? n = 
min{fc: log p (t^ fc ^) > n} = min{/c: A; + <5W > n — log p (a£)}. Introduce the event 0' := {5^ — >• 
0, log p (a£) ^ Z}. When estimated at any oj G 0', r) n = \n — log p (a£)] = n — Llog p (a:£)J for all n 
big enough; and P{fi'} = 1 since the distribution function of random variable £ is continuous 
in (0,oo) (see f)15[) . where the random variables £• have continuous densities on (0, 00) by 
Proposition [1]). 

Now fix a k G Z. By (|35]l . 

y(r?n+fc) y(??n+fc) pfc pfc 

= n ► YC— n r^rr a-s. as n -> 00, 

where 

/■ >g P ("C) 1 

p Liog p (aC)J p Liog P «)J a ^ 7 

Now we proceed with the proof of Theorem [TJ 
Lemmas [7J and [8] imply that the convergence ([2]) holds with 

£ := pOogpK)}. 

By definition, £ takes values in [l,p), and it is left to calculate its distribution. 
Fix an x G [1, p). Since 

P{£ > x} = P{{log p «)} > log p = E mez p {™ + lQ gp 2 < logp(aC) < m + 1} 
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we have, by Lemma El 

> x 



X E '{p'" + " + Va < E' , E" , «?' < p m+ " +2 /<»} . 



Note that E nj / does not depend on n, 

^ = E v{p m */<* < E J , E' , ^ < p m+1 /^ 
= E mez p i m + lQ gp x ^ lo M« E- =1 E < m + !> 

= P{{log p (a Y! l=1 E-ii ^° ))} " log " X} ' 
and this finishes the proof. □ 

6.4 Proof of Theorem [5] 

The proof consists of several steps. Throughout the proof, we assume that the function Q(-) is 
defined by ([6]). First we show that the process £Q(-/£) coincides a.s. with the pointwise limit of 

the scaled processes Q^(-)- Then we check that Q(-) satisfies ([5]) and is continuous. Finally, we 
prove that the pointwise convergence of the processes Q (•) implies their uniform convergence 
on compact sets. 

Pointwise convergence To start with, we define the auxiliary event Q' on which, as n — > oo, 

i(t^ +k) )/p n ^ P kb -^^Z, i = i,...,i, kez, 

Ei(t)/t->\i and B,i(t)/t^p u i = l,...,I. 

By theorem [H fl2g|) and the SLLN, P{^'} = 1. 
We will now show that on fi', as n — > oo, 

Q W (*) £Q(*/£) for all t £ [0, oo) , (36) 

where Q(-) is given by ([U]). 

Fix a queue number z and an outcome u € f2'. All random objects in the rest of this part of the 
proof will be evaluated at this uj. 

For t = 0, the convergence ([36]) holds since the system starts empty. For t > 0, we consider the 
three possible cases. 

Case 1 : t £ P k ^i+i^) f or a k £ *Z. By the definition of 0', for all n big enough, 

implying that queue i is in service during [t[ Vn+k \ p n t), and hence 

Q l ( P n t) = Qi(& n+k) ) + (Ei( P n t) - ^(# n+fc) ) - (Di(p n t) - A(<i" B+fc) ), 
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where 

A(p n t) - Di(t^ +k) ) = BMt^+Q) + (p n t - t^ +h) )) - BMt^+Q)). 
Again by the definition of 0,', the last two equations imply that, as n — > oo, 

Qf\t) -> p%4 + Xi(t- p%0 -in(t- P %0 = 
Case 2: t G [p% + it p k+ %0 for a k £ Z. In this case, for all n big enough, 

*& +fc) /p B < t < 4 v " +k+1) / P n , 

and hence, queue i is not in service during [p n t, ti +k ), i.e. 

Ql (t^ +k+1) ) = Q^pH) + ^(f " +fc+1 >) - EiOT), 

implying that 

Qt\t) / +1 a M £ - - 1) = tQi(t/0- 

Case 3: t = p k ~b~i£ for a k G Z. Since, as n — > oo, 

4T"i + * -1 V A Vie, t^/p^t and *& +i V->A + ie 

and the limits satisfy the inequality 

/"Vie < 1 < pVi£, 

all n big enough fall into the two sets 

Ml := {n: < < fgft +fc) } and A/* a := {n: < p n t < t { ^ +k) }. 

For I = 1, 2, we have to check that, if the set A/} is infinite, then 

Qi (*) P fc aj,ie as n -> oo, n G A/j. (37) 

For 1 = 1, (|38p follows along the lines of Case 1. For I = 2, we can prove (|38|) following the lines 
of Case 2 and replacing k + 1 with fc. 

Equivalence of © and © Let Q(-) = (Qi, . . . , Qi)(-) be the unique solution to 
whereas Q(-), as before, is given by ([5]). Fix a queue number i. The slopes of Qj(-) and 
Qi(-) coincide everywhere. Also Qj(0) = = Qi(0), and Q i {jp K bi) = p k ai^ = Qi{p k bi), k G Z. 
Then it is left to check that 

Qi(p k bj) = p k a jyi = Qi{p%), j^i, keZ. (38) 

We have, 

p k bj G [p k -% +1> p k bi) and q_i{p k bj) = p k {bi_- Ai(5j - &,)), j < i, 
G [p fc 6 i+ i,p fe+1 ^) and Qi(p k bj) = p k (pbi - \{pbi - b,)), j > i. 

Then (|38|) follows from the equations 

Q*^) = ft(4 n) ) + mf) - w$\ 3 < t, 
Qi(t +1) ) = Qsf ] ) + Ei(t +1) ) - mf), j > i, 

by Lemma [7J and Remark [7J 
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Continuity of Q(-) Fix a queue number i. As defined by (|6|), the function Qj(-) might have 
discontinuities only at t = and f = p k bi + \, k G Z. 

Note that sup tg[pfc _i^ pfcKi) = p k a ijU k G Z. Then sup^Q^.-, Q^t) = sup ieZj/ < fc p fc a M -)■ 
as A; — > — oo, and hence, Qj(t) — > = Qj(0) as i — > 0. 

At t = p k b{ + i, k G Z, the function Qj(-) is right-continuous with the left limit given by 
lin Vrp fe 6 i+ i = /(^i.i + (Ai - Mi)(&t+1 - B y © and (03)' we have lin Vp fe 6i+i ^*(*) = 

Qi{p k b i+ i) = p k a i+1)i . 

Uniform convergence on compact sets Define the auxiliary event Q," on which, as n — > oo, 

Q^(') ~> £Q("/£) pointwise, and Ei(p n -)/p n — > Aj • uniformly on compact sets, i = 

As follows from the first part of the proof and the functional SLLN, Pj^"} = 1. For the 

rest of the proof, we estimate random objects at an outcome oj G Q" . Consider the scaled 

( n \ 

departure processes Di(p n -)/p n = Ei(p n -)/p n — Q { (•). These processes are monotone and, by 
the definition of 0", converge pointwise to the continuous functions Aj • —£Qi( m /Q- Then they 
converge uniformly on compact sets, and the same is true for the processes Q i (•). □ 

Appendix 

Proof of Lemma® Suppose p < 1. Then, by [51 Theorem 7.1], we have qi = 1 for all i and qc = 1- 
The latter implies that the queue length process Q(-) hits infinitely many times, and the same 
holds the workload process. Let {t^} k 

ez+ be the sequence of consecutive time instants such 
that Q(t( nfe )) = 0. For different k, the differences t^ nk+1 > — t( nfc ) are bounded from below by 
the waiting times until the first arrival into the empty system, which are i.i.d. random variables 
distributed exponentially with parameter X^i=i ^i- Therefore, t^ nk ^ — > oo a.s. as k — > oo. This 
leads to a contradiction with the fact that the system is overloaded and its total workload grows 
infinitely large with time (by the SLLN, (£f =1 J2k=i ^ ~ *)/* -> £*=i A *M - 1 > a.s. 
as t — > oo). Hence, p > 1, and then |8j Theorem 7.1] implies that qi < 1 for all i and qc < 1. □ 

Proof of Statement [TJ First we show that 

^ " y n (fe) /r n -4 Ey in probability as n oo. (39) 

By the independence between r„ and {y[^}fc£N) f° r ai l G Z+, 

p ii Er=i y ™ fc)/r ™ - Ey| - e ' r " = n} = p{| ^r=i y i fc)/Ar - Ey| - e}F{r ™ = 

Then, for any M G Z + , 

P{| n ^n (fc) /Tn - Ey | > e} < P{r rt < M} + sup P{| Vf y/ fc) /^ - EF| > e}, 

and (|39p follows as we first let n — > oo, and then M — > oo. 
Now that we have shown ([39]), the Statement follows by 

^ n\ EL Y ^/Tn\\r n /T n -t\> e/2} + P{r| ^" =i Y^/r n - EY\ > e/2} 
< n\r n /T n -r\> e/2} + P{\ /r n \ > d} 
+ P{C 2 | Y, T k U =1 Yil k) lrn - Ey|} + P{r > C 2 } 
as we first let n — > oo, and then Ci — > oo, C 2 — > oo. □ 
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